Atty. Dkt. 723-1505 
FP-2433 



U. S. PA TENT APPLICA TION 



Inventor(s): Kazumi TOTAKA 
Mitsuhiro HIKINO 



Invention: GAME BGM GENERATING METHOD AND GAME APPARATUS 



NIXON & VANDERHYE P. C. 
ATTORNEYS AT LAW 
1100 NORTH GLEBE ROAD, 8 th FLOOR 
ARLINGTON, VIRGINIA 22201-4714 
(703) 816-4000 
Facsimile (703) 816-4100 



SPECIFICATION 



TITLE OF THE INVENTION 

Game BGM Generating Method and Game Apparatus 



BACKGROUND OF THE INVENTION 

5 Field of the invention 

The present invention relates to a storing medium that stores a game BGM 
generating program, a game BGM generating method, and a game apparatus. More 
specifically, the present invention relates to a game BGM generating program, a game 
BGM generating method, and a game apparatus that generate a BGM performed for 
10 enhancing liveliness as a series of staging in accordance with an atmosphere of a game 
stage. 

Description of the prior art 

Conventionally, game software operated in a game apparatus such as a television 
game apparatus, a liquid crystal game apparatus, and etc., in order to enhance liveliness of 

15 a game, a BGM is prepared, and a player plays the game listening to the BGM. Similar to 
a game screen, regarding this BGM, a plurality of kinds are prepared in advance, and 
selectively output according to a proceeding of the game. Generally, data of a musical 
composition of this BGM is performed from a start to an end, and this performance is 
repeated, for example. In addition, in order to prevent the BGM from becoming 

20 monotonous, a player character encounters an enemy character, and when a game scene is 
changed to a fighting scene, a different BGM is performed. Or, if a time limit set in 
advance approaches, a tempo of the performance becomes fast, and so forth. 

In addition, in order to prevent the BGM from becoming monotonous, it is 
considered to automatically generate the BGM according to a method disclosed in 

25 Japanese Patent No. 3271282 [G10H 1/00, G10H 1/40] registered on January, 25, 2002. 
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In this automatic generating method of the BGM disclosed in this prior art, a phrase 
database is prepared in advance, a phrase is newly generated based on a selected phrase, 
and a melody is automatically generated. 

However, even if the BGM is changed according to the proceeding of the game, 
5 and the tempo of the BGM is changed as in the former, the same BGM is performed in the 
same scene so that it is probable for the player to be tired of the BGM, and decrease 
interest in the game. 

Furthermore, in the latter, it is possible to generate a variety of BGMs, thus not 
probable to lose the interest. However, as an apparatus that generates the BGM for the 
10 game, its scale is large. In addition, a generating process of the phrase and the melody is 
huge so that there is a problem that a process intended for a true meaning of the game 
proceeding is oppressed. That is, such the art is not suitable for the game apparatus. 

SUMMARY OF THE INVENTION 

1 5 Therefore, it is a primary object of the present invention to provide a novel storing 

medium that stores a game BGM generating program, game BGM generating method, 
and game apparatus. 

It is another object of the present invention to provide a storing medium that stores 
a game BGM generating program, a game BGM generating method, and a game 
20 apparatus capable of generating a variety of BGMs while not increasing a process load. 

A storing medium that stores a game BGM generating program according to the 
present invention, and the game BGM data generating program is executed by a game 
apparatus. The game apparatus comprises a phrase data storing means, a rhythm-pattern 
storing means, a BGM-data playing means, a sound-data storing means, and a sound 
25 outputting means. The phrase data storing means stores by each group based on a musical 
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characteristic different kinds of a plurality of phrase data that designate a length and a 
pitch of a sound. The rhythm-pattern storing means stores at least one kind of rhythm 
pattern data constructed of two or more rhythm data that designate a length in 
performance for playing a phrase, and a play timing of the phrase. The BGM-data 
5 playing means plays BGM data constructed of at least one part. The sound-data storing 
means stores data of a sound output according to the BGM data. Furthermore, the sound 
outputting means outputs the sound according to the BGM data reproduced by the 
BGM-data playing means. The game BGM generating program allows a processor of the 
game apparatus to execute a phrase selecting step, a rhythm selecting step, a BGM 

10 generating step. The phrase selecting step randomly selects one kind of the phrase data 
from one group stored in the phrase data storing means. The rhythm selecting step selects 
one rhythm data from one kind of the rhythm pattern data stored in the rhythm-pattern 
storing means according to a predetermined rule. Furthermore, the BGM generating step 
generates the BGM data from the phrase data selected by the phrase selecting step and the 

15 rhythm data selected by the rhythm selecting step. 

More specifically, the game apparatus (12: reference numeral. Hereinafter, the 
same is true.) comprises a phrase data storing means (40, 76), a rhythm-pattern storing 
means (40, 78), a BGM-data playing means (36), a sound-data storing means (40, 54), 
and a sound outputting means (34a, 52, 62). The phrase data storing means (40, 76) stores 

20 by each group based on a musical characteristic different kinds of a plurality of phrase 
data that designate a length and a pitch of a sound. The phrase corresponds to a musical 
score (musical script) of one part of a music composition, the data corresponding thereto 
is the phrase data, for example. The rhythm-pattern storing means (40, 78) stores at least 
one kind of rhythm pattern data constructed of the rhythm data that designates a length in 

25 performance for performing a phrase, and a play timing of the phrase. The rhythm is 
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defined by a musical tone, and the data corresponding to the musical tone is the rhythm 
data, for example. The BGM-data playing means (36) plays BGM data constructed of at 
least one part (musical instrument and orchestra). The sound-data storing means (40, 54) 
stores a sound output according to the BGM data, that is, data regarding the musical 
5 instrument and the orchestra. The sound outputting means (34a, 52, 62) outputs the 

sound according to the BGM data reproduced by the BGM-data playing means (36, S 1 1 3, 
SI 83). That is, the BGM is reproduced. The game BGM generating program allows a 
processor of the game apparatus to execute a phrase selecting step (S91, SI 57), a rhythm 
selecting step (S59 5 S133), and a BGM generating step (S113, S183). The phrase 

10 selecting step (S91, SI 57) randomly selects one kind of the phrase data from one group 
stored in the phrase data storing means (40, 76). The rhythm selecting step (S59, SI 33) 
selects the rhythm data from one kind of the rhythm pattern data stored in the 
rhythm-pattern storing means (40, 78) according to a predetermined rule. The BGM 
generating step (SI 13, SI 83) generates the BGM data from the phrase data selected by 

15 the phrase selecting step (S91, SI 57) and the rhythm data selected by the rhythm 
selecting step (S59 3 S133). 

According to the present invention, the BGM data is generated from the phrase 
data selected randomly and the rhythm data selected according to a predetermined rule so 
that it is possible to generate the various BGM data. In addition, the phrase data and the 

20 rhythm data are prepared in advance so that a generating process of such the data is not 
needed, thus possible to prevent a process load from becoming large. 

According to a certain embodiment of the present invention, the rhythm selecting 
step includes a random-selecting step for randomly selecting the rhythm data from one 
kind of the rhythm pattern data. More specifically, the random-selecting method (SI 33) 

25 randomly selects a rhythm from one kind of the rhythm pattern data so that it is possible 
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to perform the BGM according to the various rhythm patterns. 

In another embodiment of the present invention, the rhythm selecting step 
includes a sequential-selecting step for selecting the rhythm data from one kind of the 
rhythm pattern data in predetermined order. More specifically, the rhythm selecting step 
5 (S59) selects the rhythm data from one kind of the rhythm pattern data in predetermined 
order so that it is possible to perform the BGM according to the rhythm pattern set in 
advance. 

In a certain aspect of the present invention, the game apparatus further comprises a 
continuous counter for counting the number of selecting times of the same phrase. The 

10 phrase selecting step includes an incrementing step and a re-selecting step. The 

incrementing step increments the continuous counter when the phrase data selected last 
time and the phrase data selected this time agree. The re-selecting step re-selects the 
phrase data when a count value of the continuous counter is larger than a predetermined 
value. More specifically, the game apparatus (12) further comprises a continuous counter 

1 5 (40, 82d) for counting the number of selecting times of the same phrase. The 

incrementing step (S95, SI 61) increments the continuous counter (40, 82d) when the 
phrase data selected last time and the phrase data selected this time agree. The 
re-selecting step (S91, SI 57) re-selects the phrase data when a count value of the 
continuous counter (40, 82d) is larger than a predetermined value. That is, as a result of 

20 the same phrase being repeatedly selected, the BGM is prevented from becoming 
monotonous. 

In another aspect of the present invention, the game apparatus further comprises 
an operating means for inputting an operation by a player; and a performance-change data 
storing means for storing performance-change data that changes a performing method of 
25 a BGM. The game BGM generating program further allows the processor to execute a 
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performance-change data storing step, and a BGM-data change step. The 
performance-change data storing step allows the performance-change data storing means 
to store the performance-change data corresponding to at least the operation of the 
operating means. The BGM-data change step applies a predetermined change to the 
5 BGM data corresponding to the performance-change data stored in the 

performance-change data storing means by the performance-change data storing step. 
More specifically, the game apparatus (12) further comprises an operating means (22, 26) 
for inputting an operation by a player; and a storing means (40, 80) for storing 
performance-change data that changes a performing method of a BGM. The game BGM 

10 generating program executes a performance-change data storing step (S21, S25, S33), 
and a BGM-data change step (SI 19, S121, S125, S171, S187, S191). The 
performance-change data storing step (S21, S25, S33) stores performance-change data 
into the performance-change data storing means (40, 80) corresponding to at least the 
operation of the operating means. However, the performance-change data may be stored 

1 5 corresponding to a proceeding situation of the game, a predetermined event, and etc. The 
BGM-data change step (SI 19, S121, S125, S171, S187, S191) applies a predetermined 
change to the BGM data corresponding to the performance-change data stored in the 
performance-change data storing means (40, 80). That is, as a result of the performance 
of the BGM being changed corresponding to the operation of the player, and etc., a 

20 staging effect of a game content, and etc., is enhanced not only by a game screen but also 
by the BGM. 

In a certain embodiment of the present invention, the BGM-data change step 
includes a tempo change step for changing a tempo of the BGM data according to the 
performance-change data. More specifically, the tempo change step (SI 25, SI 91) 
25 changes the tempo of the BGM data according to the performance-change data. That is, it 
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is possible to alter a performance speed of the BGM. 

In another aspect of the present invention, the game apparatus further comprises a 
period designating data storing means for storing period designating data that designates 
a performing period and a performance suspended period of the phrase. The BGM-data 
5 playing means suspends a reproduction of the BGM data in the performance suspended 
period based on the period designating data. The game BGM generating program further 
allows the processor to execute a period counting step for counting the performing period 
and the performance suspended period designated by the period designating data by the 
number of selecting times of the rhythm data. More specifically, the game apparatus (12) 

10 includes a period designating data storing means (40, 82b, 82c) for storing period 

designating data that designates a performing period and a performance suspended period 
of the phrase. The BGM-data playing means (36) suspends a reproduction of the BGM 
data in the performance suspended period based on the period designating data. In the 
game BGM generating program, a period counting step counts the performing period and 

1 5 the performance suspended period designated by the period designating data by the 
number of selecting times of the rhythm data. Thus, the performing period and the 
performance suspended period are counted by the number of selecting times of the 
rhythm so that even in a case that the state is returned (moved) from a performance 
suspended state to a performing state, no deviance is occurred to a timing of pronouncing 

20 the phrase, that is, a performing timing of the BGM. 

A game BGM generating method according to the present invention is a game 
BGM generating method in a game apparatus provided with a phrase data storing means, 
a rhythm-pattern storing means, a BGM-data playing means, a sound-data storing means, 
and a sound outputting means. In this game apparatus, the phrase data storing means 

25 stores by each group based on a musical characteristic different kinds of a plurality of 
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phrase data that designate a length and a pitch of a sound. The rhythm-pattern storing 
means stores at least one kind of rhythm pattern data constructed of two or more rhythm 
data that designate a length in performance for performing a phrase, and a play timing of 
the phrase. The BGM-data playing means plays BGM data constructed of at least one 
5 part. The sound-data storing means stores data of a sound output according to the BGM 
data. Furthermore, the sound outputting means outputs the sound according to the BGM 
data reproduced by the BGM-data playing means. This game apparatus (a) randomly 
selects one kind of the phrase data from one group stored in the phrase data storing 
means, (b) selects one rhythm data from one kind of the rhythm pattern data stored in the 

10 rhythm-pattern storing means sequentially or randomly, and (c) generates the BGM data 
from the phrase data selected by the step (a) and the rhythm data selected by the step (b). 

A game apparatus according to the present invention is a game apparatus that 
performs a BGM at least corresponding to a process of a game. This game apparatus 
comprises a phrase data storing means, a rhythm-pattern storing means, a BGM-data 

1 5 playing means, a sound-data storing means, a phrase selecting means, a rhythm-pattern 
selecting means, a BGM generating means, and a sound outputting means. The phrase 
data storing means stores by each group based on a musical characteristic different kinds 
of a plurality of phrase data that designate a length and a pitch of a sound. The 
rhythm-pattern storing means stores at least one kind of rhythm pattern data constructed 

20 of two or more rhythm data that designate a length in performance for performing a 

phrase, and a play timing of the phrase. The BGM-data playing means plays BGM data 
constructed of at least one part. The sound-data storing means stores data of a sound 
output according to the BGM data. The phrase selecting means randomly selects one 
kind of the phrase data from one group stored in the phrase data storing means. The 

25 rhythm-pattern selecting means selects one rhythm data from one kind of the rhythm 
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pattern data stored in the rhythm-pattern storing means according to a predetermined rule. 
The BGM generating means generates the BGM data from the phrase data selected by the 
phrase selecting step and the rhythm data selected by the rhythm pattern selecting step. 
Furthermore, the sound outputting means outputs the sound according to the BGM data 
5 reproduced by the BGM-data playing means. 

In an invention of the game BGM generating method and the game apparatus, too, 
similar to the invention of the storing medium that stores the game BGM generating 
program, it is possible to generate a variety of BGMs without increasing a process load. 
The above described objects and other objects, features, aspects and advantages of 
1 0 the present invention will become more apparent from the following detailed description 
of the present invention when taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an illustrative view showing one example of a game system of the 
1 5 present invention; 

Figure 2 is block diagram showing electric structure of a video game apparatus 
shown in a Figure 1 embodiment; 

Figure 3 is an illustrative view showing a memory map of a main memory shown 
in Figure 2; 

20 Figure 4 is an illustrative view showing one portion of the memory map shown in 

Figure 2; 

Figure 5 is an illustrative view showing a memory map of an ARAM shown in 
Figure 2; 

Figure 6 is an illustrative view showing phrase data and rhythm data shown in 
25 Figure 3; 
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Figure 7 is an illustrative view showing data structure of conductor data shown in 
Figure 3; 

Figure 8 is a flowchart showing one portion of a game process of a CPU shown in 
Figure 2; 

5 Figure 9 is a flowchart showing another portion of the game process of the CPU 

shown in Figure 2; 

Figure 10 is a flowchart showing one portion of a BGM generation and a 
reproduction process of the CPU shown in Figure 2; 

Figure 1 1 is a flowchart showing another portion of the BGM generation and the 
10 reproduction process of the CPU shown in Figure 2; 

Figure 12 is a flowchart showing still another portion of the BGM generation and 
the reproduction process of the CPU shown in Figure 2; 

Figure 13 is a flowchart showing yet still another portion of the BGM generation 
and the reproduction process of the CPU shown in Figure 2; 
15 Figure 14 is a flowchart showing another portion of the BGM generation and the 

reproduction process of the CPU shown in Figure 2; 

Figure 1 5 is a flowchart showing still another portion of the BGM generation and 
the reproduction process of the CPU shown in Figure 2; 

Figure 16 is a flowchart showing yet still another portion of the BGM generation 
20 and the reproduction process of the CPU shown in Figure 2; 

Figure 17 is an illustrative view showing a generating method of a BGM in a case 
of selecting a rhythm in a sequentially selecting method; 

Figure 18 is an illustrative view showing a performing method of the BGM in a 
case that a performing period and a performance suspending period are defined; 
25 Figure 19 is an illustrative view showing the performing method of the BGM at a 
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normal tempo and a swing tempo; and 

Figure 20 is an illustrative view showing the generating method of the BGM in a 
case of selecting the rhythm in a random selecting method. 



5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Figure 1, a video game system 10 of this embodiment includes a 
video game apparatus 12. A power is supplied to this video game apparatus 12 ? and this 
power may be an ordinary AC adaptor (not shown) in the embodiment. The AC adaptor 
is inserted into a home-use conventional wall outlet, and converts a home-use power into 

10 a low DC voltage signal appropriate for driving the video game apparatus 12. In another 
embodiment, a battery may be used as the power. 

The video game apparatus 12 includes an approximately cubic housing 14, and at 
an upper end of the housing 14, an optical disk drive 16 is provided. In the optical disk 
drive 16, an optical disk 18, which is one example of an information storing medium that 

15 stores a game program, and etc., is attached. At a front surface of the housing 14, a 

plurality of (4 in this embodiment) connectors 20 are provided. These connectors 20 are 
connectors for connecting a controller 22 to the video game apparatus 12 by a cable 24, 
and in this embodiment, it is possible to connect a maximum of four controllers to the 
video game apparatus 12. 

20 In the controller 22, an operating means (control) 26 is provided at its upper, 

lower, side surfaces, and etc. The operating means 26 includes two analog joysticks, one 
cross key, a plurality of button switches, and etc., for example. One analog joystick is 
used for inputting a moving direction and/or a moving speed or a moving amount of a 
player character (moving image character operable by the player using the controller 22) 

25 by a slanting amount and a direction of the stick. Another analog joystick controls by a 
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slanting direction a movement of a virtual camera, for example. The cross switch is used 
for instructing the moving direction of the player character in place of the analog joystick. 
The button switch is used for instructing the movement of the player character, changing 
a viewpoint of the virtual camera of a three-dimensional image, adjusting the moving 
5 speed of the player character, and so forth. Furthermore, the button switch controls a 
menu selection, and a pointer or a cursor movement, for example. 

It is noted that in this embodiment, the controller 22 is connected to the video 
game apparatus 12 by the cable 24 integrally provided therewith. However, the controller 
22 may be connected to the video game apparatus 12 by another method such as in a 

10 wireless manner via an electromagnetic wave (radio wave or infrared ray), for example. 
In addition, needless to say, specific structure of the operating means 26 of the controller 
22 is not limited to the structure of the embodiment, and an arbitrary deformation is 
possible. One analog joystick may be sufficient, or may not be used at all, for example. 
The cross switch may not be used. 

15 Below the connector 20 at the front surface of the housing 14 of the video game 

apparatus 12, at least one (2 in this embodiment) memory slot 28 is provided. A memory 
card 30 is inserted into this memory slot 28. The memory card 30 is used for loading and 
temporarily storing a game program, and etc., read out from the optical disk 18, saving 
game data (result of the game, for example) of the game played using this game system 

20 10, and so forth. 

At a rear surface of the housing 14 of the video game apparatus 12, an AV cable 
-connector (not shown) is provided, and using the connector, a monitor 34 is connected to 
the video game apparatus 12 through an AV cable 32. Typically, the monitor 34 is a color 
television receiver, and the AV cable 32 inputs a video signal from the video game 

25 apparatus 12 to a video input terminal of the color television, and applies a sound signal to 
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an audio input terminal. Therefore, a game image of a three-dimensional (3D) video 
game may be displayed on the color television (monitor) 34, and a stereo game sound 
such as a game music, a sound effect, and etc., may be output from speakers 34a on both 
sides. Or, in a case that it is possible to realize a surround effect even in the two speakers, 
5 the game sound including a surround sound is output. 

In this game system 10, in order for a user or a game player to play the game (or 
another application), the user, first, turns on the power of the game apparatus 12, next, the 
user selects the appropriate optical disk 1 8 that stores a video game (or another 
application intended to play), and loads the optical disk 18 into the disk drive 16 of the 

1 0 game apparatus 12. Accordingly, the user allows the game apparatus 1 2 to start executing 
the video game or another application based on software stored in the optical disk 18. 
The user operates the controller 22 in order to apply an input to the game apparatus 12. 
The user starts the game or another application by operating one of features of the 
operating means 26, for example. By moving another feature of the operating means 26, 

15 it becomes possible to move the moving image character (player character) to a different 
direction or change a viewpoint (camera location) of the user in a three-dimensional (3D) 
game world. 

Figure 2 is a block diagram showing electric structure of the video game system 10 
of a Figure 1 embodiment. In the video game apparatus 12, a central processing unit 

20 (hereinafter briefly referred to as "CPU") 36 is provided. The CPU 36 is also called as a 
computer or a processor, and etc., and responsible for entirely controlling the video game 
apparatus 12. The CPU 36 or computer functions as a game processor, and the memory 
controller 38 is joined to this CPU 36 via a bus. Primarily, the memory controller 38 
controls a writing or a reading of the main memory 40 joined via the bus under the control 

25 of the CPU 36. To this memory controller 38, a GPU (Graphics Processing Unit) 42 is 
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joined. 

The GPU 42 forms one portion of a rendering means, is constructed of a single 
chip ASIC, for example, and receives a graphics command (rendering instruction) from 
the CPU 36 via the memory controller 38 so as to generate a three-dimensional (3D) 
5 game image by a geometric unit 44 and a rendering unit 46 according to that command. 
That is, the geometric unit 44 performs coordinate operation processes such as a rotation, 
a movement, a deformation, and etc., of various characters and objects in a 
three-dimensional coordinate system (constructed of a plurality of polygons. In addition, 
the polygon is a polygonal plain surface defined by at least three vertexes coordinates). 
10 The rendering unit 46 performs an image generating process such as attaching a texture 
(texture image) to each polygon of the various objects, and so forth. Therefore, the 3D 
image data to be displayed on the game screen is generated (created) by the GPU 42, and 
the image data is rendered (stored) within a frame buffer 48. 

It is noted that the data (primitive or polygon or texture, and etc.) necessary for the 
1 5 GPU 42 to execute the graphics command is obtained by the GPU 42 from the main 
memory 40 via the memory controller 38. 

The frame buffer 48 is a memory for rendering (accumulating) the image data 
worth 1 frame of a luster scanning monitor 34, for example, and overwritten by the GPU 
42 by each 1 frame. As a result of a video I/F 58 described later reading out the data of the 
20 frame buffer 48 via the memory controller 38, the 3D game image is displayed on the 
screen of the monitor 34. 

In addition, a Z buffer 50 has a storing capacity equal to the number of bits of 
depth data per the number of pixels (storing location or address) corresponding to the 
frame buffer 48 X one pixel, and stores depth information or the depth data (Z value) of 
25 dots corresponding to each storing location of the frame buffer 48. 
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It is noted that both of the frame buffer 48 and the Z buffer 50 may be constructed 
using one portion of the main memory 40. 

The memory controller 38 is also joined to an ARAM 54 via a DSP (Digital Signal 
Processor) 52. Therefore, the memory controller 38 controls the writing and/or 
5 reading-out of not only the main memory 40 but also the ARAM 54 as a sub memory. 

The DSP 52 functions as a sound processor, and according to an instruction of the 
CPU 36, uses sound waveform data (Figure 5) written in the ARAM 54 so as to generate 
audio data corresponding to the music (sound effect), a sound or voices, or the music 
(BGM) necessary for the game. 
10 Furthermore, the memory controller 38 is joined to each interface (I/F) 56, 58, 60, 

62, and 64 by the bus. The controller I/F 56 is an interface for the controller 22, and 
applies to the CPU 36 an operating signal of the operating means of the controller 22 or 
data through the memory controller 38. The video I/F 58 access the frame buffer 48, 
reads out the image data created by the GPU 42, and applies to the monitor 34 the image 
15 signal or the image data (digital RGB pixel value) via the AV cable 32 (Figure 1). 

The external memory I/F 60 joins the memory card 30 (Figure 1) inserted in the 
front surface of the game apparatus 12 to the memory controller 38. Thereby, it enables 
the CPU 36 to write the data into this memory card 30 via the memory controller 38, or 
read out the data from the memory card 30. The audio I/F 62 receives the audio data 
20 applied from the DSP 52 through the memory controller 38 or an audio stream read out 
from the optical disk 1 8, and applies to the speaker 34a of the monitor 34 the audio signal 
(sound signal) corresponding thereto. 

It is noted that in a case of the stereo sound, at least one speaker 34a is provided on 
each of both sides. In addition, as a result of the surround reproduction being performed, 
25 it is possible to make the sound to be heard as if the sound were generated from behind 
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even if there are only two speakers on the both sides. 

Furthermore, the disk I/F 64 joins the disk drive 16 to the memory controller 38, 
and therefore, the CPU 36 controls the disk drive 16. Program data, the texture data, and 
etc., read out from the optical disk 18 by this disk drive 16 are written into the main 
5 memory 40 under the control of the CPU 36. 

Figure 3 shows a memory map of the main memory 40. The main memory 40 
includes a program storing area 70, a conductor data storing area 72, a sound storing area 
74, a phrase storing area 76, a rhythm-pattern storing area 78, a flag storing area 80, a 
counter storing area 82, a phrase-number storing area 84, and etc. In the program storing 

10 area 70, the game program read out from the optical disk 18 is stored at once or partially 
and sequentially. This game program is constructed of a game main processing program 
70a, a phrase selecting program 70b, a rhythm selecting program 70c, a BGM generating 
program 70d, a BGM performing program 70e, an operation inputting program 70f, a 
BGM performance-change applying program 70g, and etc., in this embodiment. 

15 The game main processing program 70a is a program for processing a main 

routine of the game. The phrase selecting program 70b is a program for randomly 
selecting phrase data from a phrase group indicated by conductor data described later. 
The rhythm selecting program 70c is a program for selecting (in order or randomly) 
rhythm data from a rhythm group indicated by the conductor data described later 

20 according to a predetermined rule. The BGM generating program 70d is a program for 
generating BGM data from the phrase data selected by the phrase selecting program 70b 
and the rhythm data selected by the rhythm selecting program 70c. 

It is noted that a plurality of kinds of the conductor data are prepared as described 
later, and one conductor data is selected by the game main processing program 70a 

25 according to the proceeding situation of the game, and etc. 
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The BGM performing program 70e is a program for performing (playing) the 
BGM data generated by the BGM generating program 70d. The operation inputting 
program 70f is a program for detecting the operation input of the controller 22 (operating 
means 26) by the player. The BGM performance-change applying program 70g is a 
5 program for applying a change in performance (output) of the BGM corresponding to the 
operation input detected by the operation inputting program 70f, the proceeding situation 
of the game, or an event, and etc. 

It is noted that although not illustrated, as the game program, an image processing 
program, too, is stored, and as a result of this image processing program being executed, 

1 0 an image of the virtual three-dimensional space (game world) of the game is displayed on 
the monitor 34, an image regarding a character such as the player character, the enemy 
character, and an item (weapon, gold coin, food, equipment, medicine, and etc.), or an 
object such as a building, a wall, a tree, and etc., is displayed, and so forth. 

In the conductor data storing area 72, different kinds of a plurality of conductor 

1 5 data such as conductor A data 72a, conductor B data 72b, conductor C data 72c, — are 
stored in this embodiment. Herein, a "conductor" means a "conductor (for orchestra)", 
and in this embodiment, the conductor data is data for generating the BGM data. Each of 
the conductor data 72a - 72c, which will be described in detail later, is constructed of 
tempo data and at least one track data. Furthermore, the track data is constructed of data 

20 (sound group number data) indicating the number (reference number) of the program 
(sound), data (phrase group number data) indicating the number (reference number) of 
the phrase group, data (rhythm group number data) indicating the number (reference 
number) of the rhythm group, and etc., (see Figure 7). 

It is noted that similar to the game program, these conductor data 72a - 72c are 

25 loaded all at once or partially and sequentially from the optical disk 18 as required. 
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In this embodiment, the sound storing area 74 is further constructed of a plurality 
of storing areas divided by each group unit, that is, a storing area 740 for a sound group 1 
(ProgOl), a storing area 742 for a sound group 2 (Prog02), — . Each of the storing area 
740 and the storing area 742 stores data of the number (reference number) allotted to the 
5 data (sound waveform data described later) of 1 or a plurality of sounds as shown in 
Figure 4 (A). It is noted that for the sake of simplicity, a name (file name) of the sound 
waveform data described later (see Figure 5) is written in Figure 4 (A). That is, in the 
storing area 740, a program (sound) A and a program D are written, and in the storing area 
742, a program B, a program C, and the program D are written. 

10 It is noted that as understood from Figure 4 (A), within each storing area, the 

number of different kinds of the sound data is written, and however, in a different storing 
area, there is a case that the number of the same kind of the sound data is written. 

In addition, the group of such the sound is set by a developer such as a 
programmer of the game, and et al., in advance. 

15 As shown in Figure 5, the sound data, that is, the sound waveform data, is loaded 

and written into the sound waveform data storing area, which is the ARAM 54 that serves 
as the sub memory in this embodiment, from the optical disk 18. As shown in Figure 5, 
the sound waveform data regarding a sound by each part is stored in the sound waveform 
data storing area, that is, the ARAM 54, for example, and as a principle, one part 

20 corresponds to one musical instrument. It is noted that there is a case that the one part 
corresponds to two or more musical instruments such as a sound of an orchestra. More 
specifically, in this embodiment, sound waveform A data (Prog_a) 54a regarding the 
sound of a piano, sound waveform B data (Prog_b) 54b regarding the sound of a bass 
(contrabass), sound waveform C data (Prog_c) 54c regarding the sound of a drum, sound 

25 waveform D data (Prog_d) 54d regarding the sound of the orchestra, and etc., are stored. 
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Although not illustrated, sound waveform data regarding another part, too, is stored. 

That is, the DSP 52 generates audio data corresponding to the sound (sound 
effect), voices, or the music (BGM) necessary for the game, using one of, or two or more 
of the sound waveform data 54a, 54b, 54c, 54d, — under the instruction of the CPU 36. 
5 Returning to Figure 3, the phrase storing area 76 is further constructed of a 

plurality of storing areas divided by each group unit, that is, a storing area 760 for a 
phrase group 1, a storing area 762 for a phrase group 2, — ., and a storing area 770 in this 
embodiment. As shown in Figure 4 (B), in each of the storing area 760 and the storing 
area 762, data of the number (reference number) allotted to one or a plurality of the phrase 

10 data is stored. As the number of the phrase data stored in one storing area, that is, in one 
group, the number of different kinds of the phrase data having a similar (approximate) 
musical characteristic is stored. Herein, the meaning of "having a similar musical 
characteristic" is that even if any phrase is performed during a musical composition, a 
sense of discomfort and a sense of malaise are not felt. 

15 However, for the sake of simplicity, a name (file name) of the phrase data is 

written in this Figure. That is, in this embodiment, a phrase A, a phrase B, a phrase C, and 
a phrase D are written in the storing area 760, and the phrase A, the phrase C, and the 
phrase D are written in the storing area 762. 

In addition, different kinds of a plurality of the phrase data are stored in the phrase 

20 data storing area 770. In this embodiment, phrase A data (Tip_a) 770a, phrase B data 
(Tip_b) 770b, phrase C data (Tip_c) 770c, phrase D data (Tip_d) 770d, — , are stored. 

Herein, the phrase means a musical score (musical script) of one portion of the 
musical composition, and its minimum constitutional unit is one musical tone. More 
specifically, as shown in Figure 6 (A), in the phrase aligned are one or more musical 

25 note(s) that designate(s) a length and a pitch (pitch of sound; height of the sound) of the 
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sound. This phrase is determined in advance by a developer such as a game programmer, 
and et al. 

To be described more specifically, in this embodiment, the phrase that 
corresponds to the phrase A data 770a is constructed of one half note, and the pitch of the 
5 sound of this musical note corresponds to a "so" note when only a treble clef is indicated. 
In addition, the phrase that corresponds to the phrase B data 770b is constructed of a 
sixteenth note, a sixteenth note, an eighth note, an eighth note, an eighth note, and a 
quarter note starting from left, and the pitch of the sound of each musical note 
corresponds to notes of "do", "re", "mi", "so", "si", "mi/" (/ means a note above one 

1 0 octave (perfect eighth). Hereinafter, the same is true.) and re/ when only the treble clef is 
indicated. Furthermore, the phrase that corresponds to the phrase C data 770c is 
constructed of an eighth note, a quarter note, an eighth note, an eighth note, a quarter note, 
and an eighth note starting from left, and the pitch of the sound of each musical note 
corresponds to notes of "so", "la", "so", "mi", "so", and "mi" when only the treble clef is 

1 5 indicated. In addition, the phrase that corresponds to the phrase D data 70d is constructed 
of a quarter note, a quarter note, a dotted quarter note, (length of a quarter note + an eighth 
note), an eighth note, a quarter note, and quarter note starting from left, and the pitch of 
the sound of each musical note corresponds to notes of "re/", "la", "la", "so", "mi", and 
"so" when the treble clef is indicated. 

20 That is, the phrase data is data regarding the musical score of one portion of the 

musical composition, and data that designates (defines) the length of the sound to be 
pronounced and the pitch of sound (musical scale). 

It is noted that as shown in Figure 4 (B), the reason why the phrase data is not 
directly stored in the storing area of the phrase group, and the storing area of the phrase 

25 group and the phrase data storing area are separately provided is that there is a case that 
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the same phrase data is included even in the different phrase group, and a data amount is 

prevented from becoming large. 

Returning to Figure 3, the rhythm-pattern storing area 78 is further constructed of 

a plurality of storing areas divided by each group unit, that is, a storing area 780 for a 
5 phrase group 1 , a storing area 782 for a phrase group 2, ••■ in this embodiment. In each of 

the storing areas, data (rhythm data) having two or more patterns are stored. More 

specifically, as shown in Figure 4 (C) in the storing area 780, rhythm A data (Rhythm_a) 

780a, rhythm B data (Rhythm_b) 780b, and the same rhythm B data (Rhythm_b) 780b are 

stored. In addition, in the storing area 782, the rhythm B data 780b, the rhythm A data 
1 0 780a, rhythm C data (Rhythm_c) 780c, rhythm D data (Rhythm_d) 780d, and the rhythm 

B data 780b are stored. 

This rhythm data is data regarding one note that designates the length of the play 

(sound) for performing the phrase (data), and a timing of a play (play timing) (starting a 

performance) of the phrase (data). As a result of the rhythm data included within one 
1 5 group being selected sequentially or randomly, the pattern (rhythm pattern) of a certain 

rhythm is formed, for example. In this respect, it can be said that collectively, the rhythm 

data included within one group is the rhythm pattern data. 

In this embodiment, as shown in Figure 6 (B), a rhythm group 1 (RhythmsOl) 

forms the rhythm pattern by the quarter note that corresponds to the rhythm A data 780a, 
20 the eighth note that corresponds to the rhythm B data 780b, and the eighth note that 

corresponds to the same rhythm B data 780b, starting from left. 

In a case that a sequential-selecting method is selected as a selecting method of the 

rhythm, the rhythm data is selected in order from a head (starting from left), that is, the 

rhythm A data 780a, the rhythm B data 780b, the rhythm B data 780b are selected in this 
25 order, and the rhythm pattern intended by the game programmer is formed, for example. 
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In addition, in a case that a random-selecting method is selected as the selecting method 
of the rhythm, the three rhythm data 780a, 780b, 780b are selected in appropriate order 
(randomly), and a plurality of kinds of the rhythm patterns are formed. 

Similarly, in a rhythm group 2 (Rhythms02), the rhythm pattern is formed of the 
5 rhythm B data 780b, the rhythm A data 780a, the rhythm C data 780c, the rhythm D data 
780d, and the rhythm B data. 

In a case that the sequential-selecting method is selected, similar to the case of the 
rhythm group 1 , each rhythm data is selected from the head in order, and the rhythm 
pattern intended by the game programmer, and et al., is formed, for example. On the 
10 other hand, in a case that the random- selecting method is selected, similar to the case of 
the rhythm group 1, the five rhythm data 780b, 780a, 780c, 780d, 780b are randomly 
selected, and a plurality of kinds of rhythm patterns are formed. 

It is noted that the data stored in the sound storing area 74, the phrase storing area 
76, and the rhythm-pattern storing area 78, too, similar to the game program, are loaded 
15 as required from the optical disk 18 all at once or partially and sequentially. 

Returning to Figure 3, in the flag storing area 80, a fighting flag 80a, an array 
in-small-number flag 80b, a physical strength decreasing flag 80c, a swing flag 80d, a 
performing period flag 80e, and a performance suspended period flag 80f are stored. 
Although not illustrated, each of the flags 80a - 80f is constructed of 1 bit of a register. 
20 When established (turned on), a data value of the register is set to "1", and on the 
contrary, when turned off, the data value of the register is set to "0". 

The fighting flag 80a is a flag for determining whether or not a scene (fighting 
scene) in which the player character, and etc., fight the enemy character, turned on in the 
fighting scene, and turned off in other cases. The array in-small-number flag 80b is a flag 
25 for determining whether or not a companion (friend) character ("PIKMIN" (trademark), 
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for example) that accompanies the player character is equal to or smaller than a 
predetermined number, and one or more character(s) is (are) dead in a certain game stage. 
This array in-small-number flag 80b is turned on in a case that the PIKMIN is equal to or 
smaller than the predetermined number, and one or more character(s) is (are) dead in the 
5 certain game stage, and turned off in other cases. The physical strength decreasing flag 
80c is a flag for determining whether or not the physical value of the player character is 
equal to or smaller than a predetermined level, turned on in a case that the physical value 
of the player character is equal to or smaller than the predetermined level, and turned off 
in a case that the physical value of the player character exceeds the predetermined level. 

10 The swing flag 80d is a flag for determining whether or not to change a counting 

method of the tempo of the BGM to be performed, turned on in a case of changing the 
counting method of the tempo, and turned off in a case of not changing the method. The 
performing period flag 80e is a flag for determining a performing period of the BGM, 
turned on in a case of being in the performing period of the BGM, and turned off in other 

15 cases. In addition, the performance suspended period flag 80f is a flag for determining a 
performance suspended period of the BGM, turned on in a case of being in the 
performance suspended period of the BGM, and turned off in other cases. 

In the counter storing area 82, a plurality of counters are provided, and in this 
embodiment, a rhythm step counter 82a, a performing period counter 82b, a performance 

20 suspended period counter 82c, and a phrase continuous counter 82d are provided. Each 
of the counters 82a - 82d is constructed of a register, and used in generating and playing 
processes (see Figure 10 - Figure 16) of the BGM described later, for example. 

The phrase-number storing area 84 is an area used in the generating and playing 
processes (see Figure 10 - Figure 16) of the BGM described later, and stores the number 

25 (hereinafter briefly referred to as "phrase number") allotted to the phrase data selected 
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when the BGM data is generated. It is noted that the phrase-number storing area 84a may 
store a name of the phrase data. 

It is noted that although not illustrated, in the main memory 40, image data of the 
game world described above, image data of the character, image data of an object, and 
5 etc., too, are stored, and these image data, too, similar to the game program, are loaded as 
required from the optical disk 18 all at once or partially and sequentially. 

Figure 7 is an illustrative view showing data structure 720 of the conductor data 
(72a, 72b, 72c, ■••)- Referring to this Figure 7, as described above, the conductor data 
(72a, 72b, 72c, — ) are constructed of tempo data 722, and a plurality of track data 724, 

10 726,728,730, 

The tempo data 722 is data for controlling a performing speed when the musical 
composition is performed. Herein, the tempo means a speed when the musical 
composition is performed, and represented using the number (bpm: beat per minutes) of a 
unit musical tone to be performed in a minute. As the unit musical note, the quarter note 

15 is generally used. However, another musical note may be used depending on the musical 
composition. That is, the tempo data 722 is data for defining (designating) at which speed 
this unit musical note is performed. 

Therefore, when the audio data corresponding to the BGM is generated, according 
to this tempo data 722, similar to a case that a metronome produces a clicking sound, for 

20 example, the DSP 52 generates pulse data including a pulse rendered a high level at a 
timing that the clicking sound is produced. However, a pulse width is determined by a 
length of a beat (unit musical note), and in default tempo data, a time-period interval 
between the beat on the top in which the unit musical note exists and the beat on the 
bottom in which no musical note exists is set to the same interval. 

25 Each of the track data 724, 726, 728, 730 is data regarding one or more part(s) 
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(musical instrument, orchestra, and etc.) responsible for performing the musical 
composition (BGM) based on the conductor data concerned (72a, 72b, 72c, — ). This 
track data 724 (same is true of the track data 726, 728, 730) is constructed of color-tone 
group number data 724a, phrase group number data724b, rhythm group number 
5 data724c, rhythm selecting-method identifying data 724d, performing period data 724e, 
performance suspended period data 724f, sound volume data 724g, acoustic data 724h, 
and transposition data724i. 

The color-tone group number data 724a is data indicating the number (reference 
number) added to the program (color tone) group (Prog). However, the color-tone group 
1 0 number data 724a may be data indicating a name of a color tone group in place of the 

number (reference number) of the color tone group. Therefore, by referring to this color 
tone group data 724a, it become possible to specify the storing area for storing the number 
of the sound waveform data (Wave a, Waveb, Wave_c, •••) used for playing the track 
724. 

1 5 The phrase group number data724b is data indicating the number (reference 

number) added to the phrase group (Tips). However, the phrase group number data724b 
may be data indicating a name of the phrase group in place of the number (reference 
number) of the phrase group. Therefore, by referring to this phrase group number 
data724b, it becomes possible to specify the storing area for storing the number of the 

20 phrase data used for playing the track 724. 

The rhythm group number data724c is data indicating the number (reference 
number) added to the rhythm group (Rhythms). However, the rhythm group number 
data724c may be data indicating a name of the group in place of the number (reference 
number) of the rhythm group. Therefore, by referring to this rhythm group number 

25 data724c, it becomes possible to specify the storing area for storing the rhythm group 
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(rhythm pattern) used for playing the track 724. 

The rhythm selecting-method identifying data 724d is data for identifying a 
selecting method of the rhythm data — within the selected rhythm group. In this 
embodiment, there are the two selecting methods, that is, the sequential-selecting method, 
5 in which the rhythm data is selected according to the order of a table, and the 

random-selecting method, in which the rhythm data is randomly selected. By referring to 
this rhythm selecting-method identifying data 724d, it becomes possible to identify the 
selecting method of the rhythm data used for playing the track 724. 

The performing period data 724e is data for designating (defining) the performing 

10 period of the musical composition, and more specifically, determined by the number of 
selecting the rhythm data in the selected rhythm group (rhythm pattern). However, to be 
exact, a manner of counting the number of selecting the rhythm data defers between the 
sequential-selecting method and the random-selecting method. In the 
sequential-selecting method, when all the rhythm data included in the selected rhythm 

1 5 pattern are counted, one period (one cycle) is counted. On the other hand, in the 

random-selecting method, at each time that the rhythm data included in the selected 
rhythm pattern is selected, one cycle is counted. That is, the performing period data 724e 
is data indicating the number of this cycle. 

The performance suspended period data 724f is data for designating a 

20 performance suspended period of the musical composition, and similar to the performing 
period data 724e, data for indicating the number of selecting the rhythm data in the 
selected rhythm group (rhythm pattern). However, the difference in the manner of 
counting the number to selecting times, that is, the cycle, between the sequential-selecting 
method and the random-selecting method is the same as the case of the performing period 

25 data 724e. Thus, the reason why it is designated by the number of times of selecting the 
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rhythm data regarding the performance suspended period, too, is to prevent a deviance of 
an outputting timing of the sound from occurring in a case of resuming the performance 
from a performance suspended state. 

The sound volume data 724g is data indicating a sound volume (volume of the 
5 sound). The acoustic data 724h is data indicating a pan of sound (surround). The 

transposition data724i is data indicating a width of a transposition (change in key), and 
data that corresponds to a key signature such as " b "#", and etc. 

The game in this embodiment is a game in which the player character, that is, a 
main character, leads the PIKMIN, that is, the companion (friend) character, and clears 

10 various events such as fighting the enemy character, and so forth so as to realize a final 
outcome, for example. In this game, the PIKMIN is a life form having a double 
characteristic of a plant and an animal, and has on an end portion of its head a sprout 
extending from a ground. When the player character pulls out the sprout, and then, the 
PIKMIN becomes part of the companions (array). In addition, there are two player 

1 5 characters, that is, a main character and a sub character, the player operates the controller 
22 (operating means 26), and by appropriately exchanging between the main character 
and the sub character, the player effectively clears the various events. 

To be described briefly, the player character of the main role (hereinafter briefly 
referred to as "main character"), and the player character of the sub role (hereinafter 

20 briefly referred to as "sub character") can act together, and in this case, the array of the 
PIKMINs follow both the main character and the sub character. In addition, the player 
separates the main character and the sub character as required, and is able to operate 
separately. In this case, a divided array of the PIKMINs follow each of the main character 
and the sub character. Therefore, it is possible for the main character to allow the array of 

25 the PIKMINs that follows the main character itself to fight the enemy character, and on 
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the other hand, it is possible for the sub character to allow the array of the PIKMINs that 
follow the sub character itself to do a task such as building a bridge. 

Furthermore, in the fighting scene, there is a case that the PIKMIN(s) is (are) eaten 
by the enemy character, and thereby, the array of the PIKMINs that follows the main 
5 character and the sub character is decreased. 

In such an AI action game and a role playing game, generally, during a proceeding 
of the game, the BGM is performed, and the BGM is changed according to a proceeding 
situation of the game, and etc. A different BGM is performed between a case that a 
normal game world is displayed and a case that the fight scene is displayed, for example. 
10 However, in the normal role playing game, the same BGM is performed in the 

same scene (situation) so that it is probable that the player becomes tired of the BGM 
while repeating the game, and loses interest in the game itself. 

To prevent this problem, in this embodiment, the BGM is generate at each time, 
and even in the same scene, it is intended to prevent the same BGM from being performed 
15 as much as possible. Thereby, the interest in the game is prevented from being lost. 

More specifically, as a result of the CPU 36 shown in Figure 2 executing the game 
program as shown in Figure 3, a flowchart shown in Figure 8 and Figure 9 is processed. 
As shown in Figure 8, when the CPU 36 starts the game process, a game main process is 
executed in a step S 1 . 

20 Although detailed descriptions will be omitted, in this step S 1 , a proceeding of the 

game is controlled, a game screen corresponding to the proceeding of the game is 
displayed, a display of the player character and the enemy character is controlled, and so 
forth. If the player operates the analog joystick (or 3D joystick), out of the operating 
means 26 of the controller 22, and in response thereto, the CPU 36 receives data 

25 regarding a slanting direction and a slanting amount of the joystick from the controller I/F 



-28- 



56, and based on this data, changes a location of the player character in the game world 
(world coordinate system). 

In addition, while the game is proceeding, the BGM corresponding to the 
proceeding situation of the game, and etc., is performed. In the fighting scene, for 
5 example, the conductor data corresponding to the fighting scene is selected, and based on 
the selected conductor data, the BGM data is generated. In addition, according to an 
instruction of the CPU 36, the DSP 52 generates the audio data according to the BGM 
data. The generated BGM data is converted into an audio signal in the audio I/F 62, and 
then, output from the speaker 34a. That is, the BGM is performed. This process of the 
10 generation output (reproduction) of the BGM will be described later in detail (see Figure 
10 -Figure 16). 

In a succeeding step S3, it is determined whether or not the enemy character exists 
within a predetermined range. If "NO" in this step S3, that is, unless the enemy character 
exists within the predetermined range, the process directly proceeds to a step SI 3. On the 

1 5 other hand, if "YES" in the step S3, that is, in a case that the enemy character exists within 
the predetermined range, it is determined whether or not the enemy character is in a 
fighting state in a step S5. If "NO" in the step S5, that is, unless the enemy character is in 
the fighting state, the track (enemy atmosphere track) data for expressing an existence of 
the enemy character by the sound (music) is added to the conductor data regarding the 

20 BGM currently being performed in a step SI 1, and the process proceeds to a step S3 5 
shown in Figure 9. 

On the other hand, if "YES" in the step S5, that is, in a case that the enemy 
character is in the fighting state, the fighting flag 80a is turned on in a step S7, and the 
track (fighting track) data for expressing the fighting scene by the sound (music) is added 
25 to the conductor data regarding the BGM currently being performed, and the process 
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proceeds to the step S35 shown in Figure 9. 

In the step S 1 3 ? it is determined whether or not the event is under progress. In this 
embodiment, the event means a state in which a plurality of the PIKMINs carry a thing or 
the enemy character defeated by the fight, destroy a gate, do a job of securing a path such 
5 as building the bridge, and so forth. If "YES" in the step SI 3, that is, in a case that the 
event is under progress, the track (event track) data for expressing that the event is under 
progress by the sound (music) is added to the conductor data regarding the BGM 
currently being performed in a step SI 5, and the process proceeds to the step S3 5 shown 
in Figure 9. 

10 On the other hand, if "NO" in the step SI 3, that is, unless the event is under 

progress, it is determined whether or not the number of the PIKMINs forming the array is 
equal to or smaller than a predetermined number (30, for example) in a step S 1 7. If "NO" 
in the step SI 7, that is, in a case that the number of the PIKMINs forming the array 
exceeds the predetermined number, the process advances to a step S23 shown in Figure 9. 

15 However, if "YES" in the step SI 7, that is, in a case that the number of the PIKMINs 
forming the array is equal to or smaller than the predetermined number, it is determined 
whether or not one or more PIKIMN(s) is (are) dead in that stage (fighting scene) in a step 
S19. 

If "NO" in the step SI 9, that is, in a case that no PIKMIN is dead in the stage, the 
20 process advances to the step S23 shown in Figure 9. On the other hand, if "YES" in the 
step SI 9, in a case that one or more PIKMIN(s) is (are) dead in the stage, the flag, that is, 
the array in-small-number flag 80b, for determining whether or not the array of the 
PIKMINs is decreased, is turned on in a step S21, and the process advances to the. step 
S3 5 shown in Figure 9. 
25 The reason why in a case that the number of the PIKMINs is thus equal to or 
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smaller than the predetermined number, and the PIKMIN(s) is (are) dead on the stage, the 
array in-small-number flag 80b is turned on is to distinguish from a case that the number 
of the PIKMINs forming the array is equal to or smaller than the predetermined number at 
a time of starting the game. 
5 As shown in Figure 9, in the step S23, it is determined whether or not the physical 

strength of the player character is equal to or smaller than the predetermined level. If 
"YES" in the step S23, that is, if the physical strength of the player character is equal to or 
smaller than the predetermined level, the flag, that is, the physical strength decreasing 
flag 80c, for determining that the physical strength of the player character is decreased is 

10 turned on in a step S25, and the process advances to the step S35. 

On the other hand, if "NO" in the step S23, that is, in a case that the physical 
strength of the player character exceeds the predetermined level, it is determined whether 
or not a geological formation is widened in the game world in a step S27. If "YES" in the 
step S27, that is, in a case that the geological formation is widened in the game world, 

15 track (widened track) data for expressing that the geological formation is widened 
(widening) by the sound (music) is added to the conductor data regarding the BGM 
currently being performed in a step S29, and the process advances to the step S3 5. 

However, if "NO" in the step S27, that is, unless the geological formation is 
widened in the game world, it is determined whether or not the player character is the sub 

20 (sub character) in a step S3 1 . If "NO" in the step S3 1 , that is, if the player character is the 
main (main character), the process directly advances to the step S3 5. On the other hand, 
if "YES" in the step S3 1, that is, in a case that the player character is the sub character, the 
flag, that is, the swing flag 80d, for determining whether or not to change the counting 
method of the tempo of the BGM to be performed is turned on in a step S3 3 , and the 

25 process advances to the step S3 5. 
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In the step S3 5, another game process is executed. Another game process includes 
a back-up (saving) process of the game data generated by the proceeding of the game, and 
etc. In accordance with the proceeding of the game, the game data is written into a work 
area (not shown) of the main memory 40, and the game data is updated one after another, 
5 for example. Then, when the back-up process is executed according to an instruction of 
the player and a predetermined event, the game data written in the work area of the main 
memory 40 is stored in the memory card 30 via the external memory I/F 60 (Figure 2). 

In a succeeding step S37, it is determined whether or not the game is ended. If 
"NO" in the step S37, that is, unless the game is ended, the process returns to the step SI . 
1 0 On the other hand, if "YES" in the step S3 7, that is, if the game is ended, the game process 
is ended. 

Figure 10 - Figure 16 are flowcharts showing the generating and playing 
processes. It is noted that these generating and playing processes of the BGM are 
processes regarding one track, and in a case that the two or more track data are included in 

1 5 the conductor data, the same process is simultaneously (in a parallel manner) executed 
regarding each track. 

As shown in Figure 10, when the CPU 36 starts the generating and playing 
processes of the BGM, it is determined whether or not there is a BGM stop call, that is, a 
suspending instruction (suspending command) of the reproduction in a step S41. If 

20 "YES" in the step S41, that is, in a case that there is the BGM stop call, the BGM 

currently being performed is stopped in a step S43. That is, the reproduction of the BGM 
data is suspended. Then, an initialization is executed in a step S45, and the generating 
and playing processes are returned, and the process returns to the game main process in 
the step SI shown in Figure 8. 

25 In the initialization process in this step S45, each setting is made as follows: Tips 
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(phrase group number) = 00; Rhythms (rhythm group number) = 00; rhythm step 
counter= 00; performing period flag = 0 (turned off); performing period counter = 00; 
performance suspended period counter = 00; phrase number = 00; and phrase continuous 
counter = 00. 

5 On the other hand, if "NO" in the step S41 , that is, unless there is the BGM stop 

call, it is determined whether or not there is a new BGM call, that is, a reproduction 

instruction (reproduction command) of a new BGM, in a step S47. If "NO" in the step 

S47, that is, unless there is the new BGM call, the process directly advances to a step S55. 

On the other hand, if "YES" in the step S47, the BGM currently being performed is 
10 stopped in a step S49, the initialization is executed in a step S51, the reproduction of the 

new BGM is started in a step S53, and the process advances to the step S55. 

In the initialization in the step S51, each setting is made as follows: Tips (phrase 

group number) = designated value; Rhythms (rhythm group number) = designated value; 

the rhythm step counter = 00; the performing period flag = 1 (turned on); the performing 
1 5 period counter = designated value; performance suspended period counter = designated 

value; phrase number = 00; and phrase continuous counter = 00. 

Herein, the designated value means a value designated by the conductor data. 

Therefore, a value (number) shown by the phrase group number data (724b) is set to the 

Tips, a value (number) shown by the rhythm group number data (724c) is set to the 
20 Rhythms, a value shown by the performing period data (724e) is set to the performing 

period counter 82b, and a value shown by the performance suspended period data (724f) 

is set to the performance suspended period counter 82c. 

In the step S55, it is determined whether or not the selecting method of the rhythm 

is a random mode (random selecting method). More specifically, it is determined 
25 whether the selecting method is the sequential-selecting method or the random-selecting 
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method based on the rhythm selecting method identifying data (724d) included in the 
track data (724). If "YES" in the step S55, that is, in a case that the selecting method is 
the random-selecting method, the process advances to a step SI 29 in Figure 14. 

On the other hand, if "NO" in the step S55, that is, in a case that the selecting 
5 method is the sequential-selecting method, it is determined whether or not a count value 
of the rhythm step counter 82a is "00" in a step S57. If "NO" in the step S57, that is, 
unless the count value of the rhythm step counter 82a is "00", the process advances to a 
step S103 shown in Figure 13. On the other hand, if "YES" in the step S57, that is, in a 
case that the count value of the rhythm step counter 82a is "00", the rhythm is selected in 

10 order from the selected rhythm group in a step S59. That is, one rhythm group storing 
area is selected according to the rhythm group number data (724c) included in the track 
data (724), and the rhythm data stored in this selected rhythm group storing area is 
selected in order from a head. In this embodiment, for example, in the rhythm group 
storing area shown in Figure 4 (C), the rhythm data is selected in descending order. 

15 In a succeeding step S61 as shown in Figure 1 1 , it is determined whether or not all 

the rhythms of the rhythm group are selected. That is, it is determined whether or not the 
rhythm group selected last time is the rearmost rhythm data of the group storing area. If 
"NO" in the step S61, that is, unless all the rhythms of the rhythm group are selected, the 
process advances to a step S85 shown in Figure 12. On the other hand, if "YES" in the 

20 step S61, that is, in a case that all the rhythms of the rhythm group are selected, a head 
rhythm of the rhythm group is selected in a step S63, and the number of steps of the 
selected rhythm (rhythm data) is set to the rhythm step counter 82a in a step S65. 

Herein, the number of steps means the number of steps of the selected musical 
note (rhythm) in a case that the musical note (in this embodiment, the sixteenth note) of a 

25 previously determined (predetermined) reference is the minimum unit (in this 
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embodiment, 30 steps). Therefore, in a case that the selected rhythm data corresponds to 
the quarter note, for example, "120" is set as the number of steps, and in addition, in a 
case that the selected rhythm data corresponds to the eighth note, "60" is set as the 
number of steps. Hereinafter, the same is true. 

5 In a succeeding step S67, it is determined whether or not the performing period 

flag 80e is turned on. If "NO" in the step S67, that is, in a case that the performing period 
flag 80e is turned off, the performance suspended period counter 82c is decremented in a 
step S69, determining that it is the performance suspended period, and it is determined 
whether or not the counter value of the performance suspended period counter 82c is "00" 

10 in a step S71. 

If "NO" in the step S71, that is, unless the count value of the performance 
suspended period counter 82c is "00", the process advances to a step S89 in Figure 12. 
On the other hand, if "YES" in the step S71 , that is, in a case that the count value of the 
performance suspended period counter 82c is "00", the performing period flag 80e is 

1 5 turned on in a step S73, the designated value is set to the performance suspended period 
counter 82c in a succeeding step S75, and the process advances to a step S91 shown in 
Figure 12. 

In addition, if "YES" in the step S67, that is, if the performing period flag 80e is 
turned on, the performing period counter 82b is decremented in a step S77, determining 

20 that it is the performing period, and it is determined whether or not the count value of the 
performing period counter 82b is "00" in a step S79. If "NO" in the step S79, that is, 
unless the count value of the performing period counter 82b is "00", the process directly 
advances to a step S91 shown in Figure 12. However, if "YES" in the step S79, that is, in 
a case that the count value of the performing period counter 82b is "00", it is determined 

25 whether or not the designated value of the performance suspended period counter 82c is 
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"00" in a step S81. 

If "NO" in the step S81 , unless the designated value of the performance suspended 
period counter 82c is "00", the process advances to a step SI 07 shown in Figure 13, 
determining that there is the performance suspended period. On the other hand, if "YES" 
5 in the step S81, that is, in a case that the designated value of the performance suspended 
period counter 82c is "00", the designated value is set to the performing period counter 
82b in a step S83, determining that there is no performance suspended period, and the 
process advances to the step S91 shown in Figure 12. 

As described above, in the step S61 in Figure 1 1 , in a case of being determined that 

1 0 all the rhythms of the rhythm group are not selected, as shown in Figure 12, in a step S85, 
the number of steps of the selected rhythm is set to the rhythm step counter 82a. In a 
succeeding step S87, it is determined whether or not the performing period flag 80e is 
turned on. If "YES" in the step S87, that is, in a case that the performing period flag 80e 
is turned on, the process directly advances to the step S91. However, if "NO" in the step 

1 5 S87, that is, in a case that the performing period flag 80e is turned off, it is determined 
whether or not the fighting flag 80a is turned on in a step S89. 

If "NO" in the step S89, that is, in a case that the fighting flag 80a is turned off, the 
process advances to a step SI 05 shown in Figure 13. On the other hand, if "YES" in the 
step S89, that is, in a case that the fighting flag 80a is turned on, the process advances to 

20 the step S91 . Thus, even if the performing period flag 80e is turned off, in a case that the 
fighting flag 80a is turned on, the process advances to the step S91 so as to forcedly 
perform the BGM in the fighting scene, and ignore the performance suspended period 
flag 80f 

In the step S91, the phrase is selected randomly (appropriately) from the 
25 designated phrase group. That is, one phrase group is selected according to the phrase 
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group number (724b) included in the track data (724), and the phrase number stored in the 
storing area of the selected phrase group is randomly selected by a random number, for 
example. Furthermore, the phrase data indicated by the phrase number randomly selected 
is read out (selected) from the phrase data storing area 770. In a succeeding step S93, it is 
5 determined whether or not the selected phrase number and the phrase number stored in 
the phrase-number storing area 84 agree. That is, it is determined whether or not the 
phrase data selected last time and the phrase data selected this time are the same. 

If "YES" in the step S93, that is, in a case that the selected phrase number and the 
stored phrase number agree, the phrase continuous counter 82d is incremented in a step 

10 S95, and it is determined whether or not the count value of the phrase continuous counter 
82d is equal to or more than "03" in a step S97. That is, it is determined whether or not 
the same phrase data is continuously selected for three times. If "NO" in the step S97, 
that is, in a case that the count value of the phrase continuous counter 82d is less than 
"03", the process directly advances to a step S 1 1 7 shown in Figure 1 3 . On the other hand, 

15 if "YES" in the step S97, that is, in a case that the count value of the phrase continuous 
counter 82d is equal to or more than "03", the process returns to the step S91 , determining 
that the same phrase data is continuously selected for three times. That is, in a case that 
the same phrase data is continuously selected for three times, the phrase data is 
re-selected, and the same phrase data is prevented from being continuously performed for 

20 three or more times. Thereby, the BGM is prevented from becoming monotonous. 

On the other hand, if "NO" in the step S93, that is, unless the selected phrase 
number and the stored phrase number agree, the selected phrase number is stored 
(overwritten) into the phrase-number storing area 84 of the main memory 40, and the 
count value of the phrase continuous counter 82d is set (reset) to "00" in a step S 101 , and 

25 the process advances to the step SI 17 shown in Figure 13. 
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As described above, in a case of being determined that the count value of the 
rhythm step counter 82a is "00" in the step S57 in Figure 10, it is determined whether or 
not the performing period flag 80e is turned on in a step SI 03 as shown in Figure 13. If 
"YES" in the step SI 03, that is, in a case that the performing period flag 80e is turned on, 
5 the process directly advances to a step S 1 1 3, determining that it is the performing period. 
On the other hand, if "NO" in the step SI 03, that is, in a case that the performing period 
flag 80 is turned off, the process advances to a step SI 05, determining that it is the 
performance suspended period. 

In addition, as described above, in the step S81 in Figure 1 1, in a case of being 

10 determined that the designated value of the performance suspended period counter 82c is 
not "00", the performing period flag 80e is turned off in the step SI 07 as shown in Figure 
13, the designated value is set to the performing period counter 82b in a step SI 09, and 
the process advances to the step SI 05. 

In the step S 1 05, it is determined whether or not the phrase is being reproduced. If 

15 "NO" in the step SI 05, that is, unless the phrase is being reproduced, the phrase is not 
reproduced, that is, the reproduction of the phrase is suspended in a step Sill, and the 
process advances to a step SI 27. On the other hand, if "YES" in the step SI 05, that is, if 
the phrase is being reproduced, the selected phrase is reproduced according to the 
selected rhythm data in a step SI 13, and the process advances to a step SI 15. 

20 Figure 17 is an illustrative view for describing a method of generating the BGM 

(musical score) to be performed in a case that the sequential-selecting method is selected 
as the selecting method of the rhythm. As shown in Figure 17 (A), if the rhythm group 1 
(RhythmsOl) is selected, in the sequential-selecting method, the rhythm data is repeatedly 
selected in the order of the rhythm A data (Rhythm_a) 780a, the rhythm B data 

25 (Rhythm__b) 780b, and the rhythm B data (Rhythm_b), for example. 
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Furthermore, if the phrase group 1 (TipsOl) is selected, for example, as described 
above, the phrase number included in this phrase group 1 is randomly selected. Then, the 
phrase data indicated by the selected phrase number is selected. Herein, as shown in 
Figure 17 (B), it is provided that the phrase is selected in the order of the phrase B data 
5 (Tip_b) 770b, the phrase C data (Tip_c) 770c, the phrase A data (Tip_a) 770a, the phrase 
A data (Tip_a) 770a, the phrase D data (Tip_d) 770d, and the phrase B data (Tip_b) 770b, 
for example. 

Each of the rhythm data (musical tone) shown in Figure 17 (A) corresponds to the 
phrase data (phrase) shown in Figure 17 (B). Furthermore, as described above, the 
1 0 rhythm data defines the length of the performance and the play timing for performing the 
phrase data so that each of the phrases has one of its portion extracted according to the 
corresponding rhythm, and the musical score (note) as shown in Figure 1 7 (C) is 
generated. 

That is, the phrase B data 770b that corresponds to the initial (first) rhythm A data 
1 5 780a is extracted by the length equal to the quarter note that corresponds to the rhythm A 
data 780a. That is, the first sixteenth note, the second sixteenth note, and the third 
sixteenth note that correspond to the phrase B data 770b are extracted. 

It is noted that in Figure 17 (B), in order for the extracted phrase to be easily 
understood, one portion of the phrase is surrounded by a square frame. In addition, in 
20 Figure 17 (C), the length of the sound of the musical note that corresponds to the rhythm 
data, and the length of the extracted phrase are illustrated in a relative manner using a bar 
graph. Hereinafter, the same is true. 

In the phrase C data 770c that corresponds to the second rhythm B data 780b, the 
first eighth note is extracted. The phrase A data 770a that corresponds to the third rhythm 
25 B data 780b is a phrase constructed of one musical note (half note) so that the sound 
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indicated by the half note is extracted by the length equal to the eighth note that 
corresponds to the rhythm B data 780b. In the phrase A data 770a that corresponds to the 
fourth rhythm A data 780a, too, the sound indicated by the half note is extracted by the 
length of the quarter note that corresponds to the rhythm A data 780a. In the phrase D 
5 data 770d that corresponds to the fifth rhythm B data 780b 5 the sound indicated by the 
first quarter note is extracted by the length equal to the eighth note that corresponds to the 
rhythm B data 780b. In addition, in the phrase B data 770b that corresponds to the sixth 
rhythm B data 780b, the first sixteenth note and the second sixteenth note are extracted. 
Therefore, the musical score as shown in Figure 17 (C) is generated. The data that 

10 corresponds to this musical score is the BGM data. However, as described above, in this 
generation/ reproduction process of the BGM, the process relates to one track, and 
therefore, in a case that the conductor data includes two or more track data, the BGM data 
generated in each track can be collectively referred to as the BGM data. 

The CPU 36 plays this BGM data according to the tempo data (722) included in 

15 the conductor data (720), and designates the color tone data (sound waveform data) 

indicated by the color-tone group number data 724a included in the track data (724), the 
sound volume (volume of the sound) indicated by the sound volume data (724g), and a 
volume of an acoustic sound indicated by the acoustic data (724h). That is, the BGM data 
according to the tempo data 722 is applied to the DSP 52, and the color tone data, sound 

20 volume data, and acoustic data to be used are applied (designated). The DSP 52 generates 
the audio data regarding the BGM data according thereto. This audio data is output from 
the speaker 34a via the audio I/F 62. That is, the BGM is performed (reproduced). 

It is noted that in an example shown in Figure 17, a state in which each of the 
rhythm data and the phrase data is selected for six times is displayed, and at each time that 

25 the rhythm data and the phrase data are selected once, the phrase according to the selected 
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rhythm is reproduced. If the phrase equal to the length designated by the rhythm is 
reproduced, the succeeding rhythm data and the phrase data are selected. As a result of 
such the process being repeated, the BGM is to be reproduced. 

In addition, Figure 1 8 is an illustrative view for describing a performing method of 
5 a case that the performing period and the performance suspended period are defined 

(designated). The example shown in this Figure 1 8 describes a case that the rhythm group 
1 (RhythmsOl) is selected, the phrase group 2 (Tips02) is selected, and furthermore, the 
designated value "02" is set to a performing period (OnCycle) counter 82b, the 
designated value "03" is set to a performance suspended period (OffCycle) counter 82c. 

10 As shown in Figure 18 (A), in a case that the sequential-selecting method is 

selected as the selecting method of the rhythm, as described above, the rhythm data is 
sequentially selected, and the phrase data is randomly selected. It is noted that in Figure 
1 8, for the sake of simplicity, the phrase is shown by the square frame and a pattern 
(dotted line or white-out) within the frame. In addition, the length (width) of the square 

1 5 frame corresponds to the extracted phrase, and the square frame indicated by the dotted 
line indicates that the performance is suspended. 

As described above, in a case that the sequential-selecting manner is selected, one 
period (one cycle) is counted when all the rhythm data constructing the rhythm pattern are / 
selected. Therefore, when the designated value "02" is set to the performing period 

20 counter 82b, this performing period counter 82b is decremented when all of the rhythm A 
data 780a, the rhythm B data 780b, and the rhythm B data 780b that constructs the rhythm 
pattern are selected, the performing period counter 82b. That is, the performing period 
counter 82b is decremented at each time that the rhythm pattern is selected, and when the 
count value of the performing period counter 82b becomes "00", the performance is 

25 suspended. When the performance is suspended, the designated value "03" is set to the 
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performance suspended period counter 82c, and this performance suspended period 
counter 82c is decremented when all the rhythm A data 780a, the rhythm B data 780b, and 
the rhythm B data 780b that construct the rhythm pattern, too. That is, the performance 
suspended period counter 82c is decremented at each time that the rhythm pattern is 
5 selected, and when the count value of the performance suspended period counter 82c 
becomes "00", the performance is started (resumed). That is, a state is returned (moved) 
to a performing state from the performance suspended state. 

That is, as a result of the number of selecting times of the rhythm pattern (all 
rhythm data) being counted, the performing period and the performance suspended 

1 0 period are measured (counted) so that even in a case that the state is moved from the 
performance suspended state to the performing state, no deviance is occurred to the 
timing of pronouncing the phrase. 

It is noted that in this embodiment, in the performance suspended period, by 
masking the phrase data, the sound is made not to be output, for example. 

15 Returning to Figure 13, as described above, in the step S97 in Figure 12, in a case 

that it is determined that the count value of the phrase continuous counter 82d is less than 
"03", that "00" is set to the phrase continuous counter 82d in the step S101 in the same 
Figure 12, and so forth, it is determined whether or not the array in-small-number flag 
80b is turned on in the step S 1 1 7 as shown in this Figure 1 3 . If "NO" in the step S 1 1 7, 

20 that is, in a case that the array in-small-number flag 80b is turned off, the process 

advances to the step SI 13. On the other hand, if "YES" in the step SI 17, that is, in a case 
that the array in-small-number flag 80b is turned on, one portion of the selected phrase is 
appropriately thinned out in a step SI 19, and the process advances to the step SI 13. That 
is, by performing the phrase having one portion of the sound deleted, it is staged by the 

25 sound that the PIKMIN in the array lacks. If one portion of the phrase data is masked, it is 
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possible to thin out one portion of the phrase, for example. 

It is determined whether or not the swing flag 80d is turned on in the step S 1 1 5. If 
"YES" in the step SI 15, that is, in a case that the swing flag 80d is turned on, the counting 
method of the tempo is changed (swung) to a bouncing rhythm in a step SI 21, and the 
5 process advances to a step SI 23. As described above, in this embodiment, the default 
tempo is determined in advance by the number of unit musical notes performed in one 
minute, and a time-period interval between the top of the beat and the bottom of the beat 
is set to the same interval. However, in the step S121, a change is made in such a manner 
that the time-period interval between the top of the beat and the bottom of the beat is 

1 0 rendered a ratio of 3 : 1 . Thereby, the BGM is performed in a rhythm as if to bounce. 

More specifically, as shown in Figure 19 (A), in the default tempo (Normal), the 
generated musical score, that is, the BGM, is performed at the same time-period intervals 
(at a ratio of 1 :1) between the top of the beat (On Beat) and the bottom of the beat (Off 
Beat). On the other hand, as shown in Figure 19 (B), in a case of swinging, the counting 

1 5 method of the tempo is changed in such a manner that the time-period intervals between a 
period of the On Beat and a period of the Off Beat is rendered at a ratio of 3 : 1 , that is, a 
pulse width of the pulse data generated by the DSP 52 is changed, and the BGM is 
performed according to the changed tempo. In addition, as understood from Figure 19 
(A) and Figure 19 (B), in a case that the counting method of the tempo is changed, one 

20 portion of the musical tone (length of the sound, to be exact) is changed. This is due to a 
fact that the ratio of the time-period intervals is changed between the period of the On 
Beat and the period of Off Beat. 

Thus, by changing the counting method of the tempo, the player can easily 
determine whether the player character currently operated is the main character or the sub 

25 character not only by the game screen but also by the BGM to be performed. Hereinafter, 
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the same is true. 

Returning to Figure 13, in the step SI 23, it is determined whether or not the 
physical strength decreasing flag 80c is turned on. If "NO" in the step SI 23, that is, in a 
case that the physical strength decreasing flag 80c is turned off, the process directly 
5 advances to a step S127. However, if "YES" in the step S123, that is, in a case that the 
physical strength decreasing flag 80c is turned on, the tempo is decreased in a step S125, 
and the process advances to the step S127. In the step S125, the tempo is changed in such 
a manner that the number of the unit musical tones to be performed in one minute is 
rendered half the default tempo, for example. However, the time-period interval between 

10 the top of the beat and the bottom of the beat is the same interval. That is, by extending 
the default tempo data equally in a time-period axis direction, the performing speed is 
rendered slow. Hereinafter, the same is true. 

In the step SI 27, the rhythm step counter 82a is decremented, and the process 
returns to the step S41 shown in Figure 10. That is, until the count value of the rhythm 

15 step counter 82a is rendered "00", the selected phrase is reproduced according to the 

selected rhythm, and when the count value of the rhythm counter 82a is rendered "00", a 
succeeding rhythm is selected, and the succeeding phrase is randomly selected. 

As described above, in the step S55 in Figure 10, in a case of determining that the 
selecting method of the rhythm is the random-selecting method, it is determined whether 

20 or not the count value of the rhythm step counter 82a is "00" in a step SI 29 as shown in 
Figure 14. If "NO" in the step S129, that is, unless the count value of the rhythm step 
counter 82a is "00", the process advances to the step SI 71 shown in Figure 16. On the 
other hand, if "YES" in the step SI 29, that is, in a case that the count value of the rhythm 
step counter 82a is "00", the rhythm (rhythm data) is randomly selected from the storing 

25 area of the selected rhythm group in a step S131, and the number of steps of the selected 
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rhythm is set to the rhythm step counter 82a in a step SI 33. 

In a succeeding step S135, it is determined whether or not the performing period 
flag 80e is turned on. If "NO" in the step SI 35, that is, in a case that the performing 
period flag 80e is turned off, the performance suspended period counter 82c is 
5 decremented in a step SI 37, and it is determined whether or not the count value of the 
performance suspended period counter 82c is "00" in a step SI 39. If "NO" in the step 
SI 39, that is, unless the count value of the performance suspended period counter 82c is 
"00", the process advances to a step SI 53 shown in Figure 15. On the other hand, if 
"YES" in the step SI 39, that is, in a case that the count value of the performance 

10 suspended period counter 82c is "00", the performing period flag 80e is turned on in a 
step SI 41, and after the designated value is set to the performance suspended period 
counter 82c in a step SI 43, the process advances to a step SI 55 shown in Figure 15. 

On the other hand, if "YES" in the step SI 35, that is, in a case that the performing 
period flag 80e is turned on, the performing period counter 82b is decremented in a step 

15 SI 45, and it is determined whether or not the count value of the performing period 
counter 82b is "00" in a step SI 47. 

If "NO" in the step SI 47, that is, unless the count value of the performing period 
counter 82b is "00", the process directly advances to the step SI 55 shown in Figure 15. 
On the other hand, if "YES" in the step SI 47, that is, in a case that the count value of the 

20 performing period counter 82b is "00", it is determined whether or not the designated 

value of the performance suspended period counter 82c is "00". If "NO" in the step SI 49, 
that is, unless the designated value of the performance suspended period counter 82c is 
"00", the process advances to a step SI 75 shown in Figure 16, determining that there is 
the performance suspended period. On the other hand, if "YES" in the step SI 49, that is, 

25 in a case that the designated value of the performance suspended period counter 82c is 
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"00", after the designated value is set to the performing period counter 82b in a step S 1 5 1 , 
determining that there is no performance suspended period, and the process advances to 
the step SI 55 shown in Figure 15. 

As described above, in a case that it is determined that unless the count value of 
5 the performance suspended period counter 82c is "00" in the step SI 39 in Figure 14, it is 
determined whether or not the fighting flag 80a is turned on in a step SI 53 as shown in 
Figure 15. If "NO" in the step SI 53, that is, unless the fighting flag 80a is turned on, the 
process advances to a step SI 73 shown in Figure 16. On the other hand, if "YES" in the 
step SI 53, that is, in a case that the fighting flag 80a is turned on, the phrase number is 
1 0 randomly selected from the designated (selected) phrase group in a step S 1 55, the phrase 
data indicated by the selected phrase number is read out (selected) from the phrase data 
storing area 770. 

In a succeeding step SI 57, it is determined whether or not the selected phrase 
number and the phrase number stored in the phrase-number storing area 84 agree. That 

15 is, it is determined whether or not the same phrase data is selected continuously. If 

"YES" in the step SI 57, that is, in a case that the selected phrase number and the stored 
phrase number agree, the phrase continuous counter 82d is incremented in a step SI 59, 
determining that the same phrase data is continuously selected. Then, in a step S 1 6 1 , it is 
determined whether or not the count value of the phrase continuous counter 82d is equal 

20 to or more than "03". 

If "YES" in the step SI 61, that is, in a case that the count value of the phrase 
continuous counter 82d is equal to or more than "03", the process returns to the step S 1 55 
so as to re-select the phrase, determining that the same phrase is continuously selected for 
three times. On the other hand, if "NO" in the step SI 61, that is, if the count value of the 

25 phrase continuous counter 82d is less than "03", the process directly advances to a step 
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SI 67, determining that the number of times that the same phrase is selected is equal to or 
smaller than two. 

In addition, if "NO" in the step SI 57, that is, unless the selected phrase number 
and the stored phrase number agree, the selected phrase number is stored (overwritten) 
5 into the phrase-number storing area 84 of the main memory 40 in a step SI 63, 

determining that the same phrase is not continuously selected, the count value of the 
phrase continuous counter 82d is set (reset) to "00" in a step SI 65, and the process 
advances to a step SI 67. 

In the step SI 67, it is determined whether or not the array in- small-number flag 

1 0 80b is turned on. If "YES" in the step S 1 67, that is, in a case that the array 

in-small-number flag 80b is turned on, one portion of the selected phrase is appropriately 
thinned out in a step SI 69, and the process advances to a step SI 81 shown in Figure 16. 
On the other hand, if "NO" in the step SI 67, that is, unless the array in-small-number flag 
80b is turned on, the process directly advances to a step S181 shown in Figure 16. 

15 As described above, in the step SI 29 in Figure 14, in a case that it is determined 

that the count value of the rhythm step counter 82a is not "00", it is determined whether or 
not the performing period flag 80e is turned on in the step S 1 71 as shown in Figure 16. If 
"YES" in the step SI 71, that is, in a case that the performing period flag 80e is turned on, 
the process directly advances to a step S 1 8 1 . On the other hand, if "NO" in the step S 1 7 1 , 

20 that is, in a case that the performing period flag 80e is turned off, the process advances to 
a step S173. 

Furthermore, as described above, in a case that it is determined that the designated 
value of the performance suspended period counter 82c is not "00" in the step SI 49 in 
Figure 14, the performing period flag 80e is turned off in a step SI 75 shown in Figure 16, 
25 and in a step SI 77, the designated value is set to the performing period counter 82b, and 
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then, the process advances to the step SI 73. 

In the step S 1 73 , it is determined whether or not the phrase is being reproduced. If 
"NO" in the step SI 73, that is, unless the phrase is being reproduced, the phrase is not 
reproduced in a step S 1 79, and the process directly advances to a step S 1 91 . On the other 
5 hand, if "YES" in the step SI 73, that is, in a case that the phrase is being reproduced, the 
selected phrase is reproduced in the step S 1 8 1 according to the selected rhythm, and then, 
the process advances to the step SI 83. 

Figure 20 is an illustrative view for describing a method of generating the BGM 
(musical script) to be performed in a case that the random-selecting method is selected as 

10 a method of selecting the rhythm. As shown in Figure 20 (A), it is provided that the 
rhythm group 2 (Rhythms02) is selected, and the rhythm A data (Rhythm_a) 780a, the 
rhythm A data (Rhythm_a) 780a, the rhythm B data (Rhythm_b) 780b, the rhythm D data 
(Rhythm_d) 780d, the rhythm B data (Rhythm__b) 780b, and the rhythm C data 
(Rhythm_c) 780c are selected in order in the random-selecting method, for example. 

15 In addition, the phrase group 1 (TipsOl) is selected, and as described above, the 

phrase number included in this phrase group 1 is randomly selected, and the phrase data 
that corresponds to the selected phrase number is selected from the phrase storing area 
770, for example. As described in Figure 20 (B), it is provided that the phrase is selected 
in the order of the phrase B data (Tip_b) 770b, the phrase C data (Tip_c) 770c, the phrase 

20 A data (Tip_a) 770a, the phrase B data (Tip_b) 770b, the phrase D data (Tip_d) 770d, and 
the phrase D data (Tip_d) 770d. 

Each rhythm data (musical tone) shown in Figure 20 (A) corresponds to each 
phrase data (phrase) shown in Figure 20 (B), and described above, the rhythm data 
defines the length of the performance and the play timing for performing the phrase data. 

25 Therefore, similar to the case of the sequential-selecting method shown in Figure 17, the 



-48- 



musical score (note) as shown in Figure 20 (C) is generated. 

More specifically, the phrase B data 770b that corresponds to the initial (first) 
rhythm A data 780a is extracted by the length equal to the quarter note that corresponds to 
the rhythm A data 780a. That is, the initial sixteenth note, the second sixteenth note, and 
5 the third sixteenth note that correspond to the phrase B data 770b are extracted. 

Similarly, in the phrase C data 770c that corresponds to the second rhythm A data 
780a, the first eighth note, the second quarter note, and the third eight note are extracted. 
In the phrase A data 770a that corresponds to the third rhythm B data 780b is the phrase 
constructed of one note (half note) so that the sound indicated by the half note is extracted 

10 by the length equal to the eighth note that corresponds to the rhythm B data 780ba. In the 
phrase B data 770b that corresponds to the fourth rhythm D data 780d, the first sixteenth 
note, the second sixteenth note, the third eighth note, and the fourth eighth note are 
extracted. In the phrase D data 770d that corresponds to the fifth rhythm B data 780b, the 
sound indicated by the first quarter note is extracted by the length equal to the eighth note 

1 5 that corresponds to the rhythm B data 780b. Furthermore, the phrase D data 770d that 
corresponds to the sixth rhythm C data 780c, the first quarter note, the second quarter 
note, and the third dotted quarter note, and the fourth eighth note are extracted. 

It is noted that in an example shown in Figure 20, too, similar to the example 
shown in Figure 1 7, there is shown a state that each of the rhythm data and the phrase data 

20 are selected for six times, and at each time that the rhythm data and the phrase data are 
selected for one time, the phrase according to the selected rhythm is reproduced, and 
when the phrase equal to the length designated by the rhythm is reproduced, the 
subsequent rhythm data and the phrase data are selected. Such the process is repeated, 
and thus, the BGM is reproduced. 

25 In addition, as shown in Figure 18 (B), in a case that the random-selecting method 
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is selected as the selecting method of the rhythm, as described above, each of the rhythm 
data and the phrase data is randomly selected. Furthermore, as described above, in a case 
that the random-selecting method is selected, one period (cycle) is counted at each time 
that one rhythm data constructing the rhythm pattern is selected. 
5 Therefore, when the designated value "02" is set to the performing period counter 

82b, this performing period counter 82b is decremented at each time that the rhythm data 
is selected, and when the count value of the performing period counter 82b becomes "00", 
the performance is suspended. When the performance is suspended, the designated value 
"03" is set to the performance suspended period counter 82c, and this performance 
1 0 suspended period counter 82c is decremented at each time that the rhythm data is 
selected. When the count value of the performance suspended period counter 82c 
becomes "00", the state is moved (returned) from the performance suspended state to the 
performing state. 

It is noted that in the performance suspended period, the reason why the phrase 
1 5 data is masked is the same as the case of the sequential-selecting method. 

Thus, in the random-selecting method, too, the performing period and the 
performance suspended period are measured (counted) depending on the number of 
selecting times of the rhythm data so that even in a case that the state is moved from the 
performance suspended state to the performing state, no deviance is occurred to the 
20 timing of pronouncing the phrase. 

It is noted that a case of the reproduction of the BGM is the same as the case of the 
above-described sequential-selecting method. 

Returning to Figure 1 6, in the step S 1 83, it is determined whether or not the swing 
flag 80d is turned on. If "YES" in the step SI 83, that is, in a case that the swing flag 80d 
25 is turned on, the counting method of the tempo is changed to a bounding rhythm in a step 
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S185, and the process advances to a step S187. On the other hand, if "NO" in the step 
SI 83, in a case that the swing flag 80d is turned off, the process directly advances to the 
step SI 87. 

In the step SI 87, it is determined whether or not the physical strength decreasing 
5 flag 80c is turned on. If "NO" in the step S 1 87, that is, in a case that the physical strength 
decreasing flag 80c is turned off, the process directly advances to a step SI 91. On the 
other hand, if "YES" in the step SI 87, that is, in a case that the physical strength 
decreasing flag 80c is turned on, the tempo is decreased in a step SI 89, and then, the 
process advances to the step SI 91. 

10 In the step SI 91, the rhythm step counter 82a is decremented, and the process 

returns to the step S41 shown in Figure 10. That is, until the count value of the rhythm 
step counter 82a becomes "00", the selected phrase is reproduced according to the 
selected rhythm, and when the count value of the rhythm step counter 82a becomes "00", 
the subsequent rhythm is randomly selected, and the subsequent phrase is randomly 

1 5 selected. 

It is noted that although omitted in the generating and playing processes of the 
BGM, the BGM data to be generated may be transposed according to the transposition 
data 724i. A flag (transposition flag) to be turned on/off according to a predetermined 
operation of the player, the proceeding situation of the game, or a predetermined event, 
20 and etc., is stored in the flag storing area 80, and in a case that the transposition flag is 

turned on, and then, it is possible to transpose the BGM data to be generated, for example. 
Thereby, it is also possible to perform the BGM having a half tone made higher, lower, 
and so forth. 

According to this embodiment, the BGM data is generated from the phrase data 
25 selected randomly according to the conductor data selected depending on the proceeding 
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situation of the game, and the rhythm data selected according to a predetermined rule so 
that it is possible to make a chance of the same BGM to be performed least probable. 
That is, a fascinating aspect of the game can be enhanced, and it is possible to prevent the 
loss of the interest in the game itself stemming from a fact that the same BGM is 
5 performed. 

In addition, the BGM data is generated using the phrase data and the rhythm data 
prepared in advance so that it is not needed to generate the phrase data and the rhythm 
data (rhythm pattern). Therefore, a process load of the CPU is not increased. 

It is noted that although in this embodiment, in a case that the array of the 
10 PIKMINs is decreased, one portion of the phrase selected in one part (track) is 

appropriately thinned out, and reproduced, and however, the reproduction of an arbitrary 
one or a plurality of the track(s) may be suspended. 

Furthermore, in this embodiment, although the phrase data and the rhythm data are 
divided into groups, and stored in plural number, it is possible to generate the various 
15 BGMs on condition that at least one group is provided for each of the data in any case. 

Moreover, in this embodiment, a change is applied to the BGM to be reproduced 
according to the operation of the player, the proceeding situation (event) of the game, and 
etc. However, these are merely examples, and items determined by a developer such as a 
game programmer, and et al. That is, it is necessary to take into consideration the point 
20 that the change is applied to the reproduced BGM according to an arbitrary event, and etc. 

In addition, in this embodiment, although only the video game apparatus as shown 
in Figure 1 is described. However, it is needless to say that the present invention can be 
adapted to a game apparatus integrally provided with a monitor and a speaker, a handheld 
game apparatus, a handheld telephone receiver provided with a game function, and etc. 
25 Although the present invention has been described and illustrated in detail, it is 
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clearly understood that the same is by way of illustration and example only and is not to 
be taken by way of limitation, the spirit and scope of the present invention being limited 
only by the terms of the appended claims. 
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